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FOREWORD 

The  policy-capturing  model  developed  by  the  Personnel  Research  Laboratory  has 
been  described  in  previous  papers  (Ward  &  Davis,  1963:  Christal,  1963,  1965).  However, 
a  fable  used  in  a  presentation  to  the  13th  Annual  Air  Force  Science  and  Engineering 
Symposium  (Christal,  1966)  was  found  to  provide  a  relatively  "painless-to-take"  descrip¬ 
tion  of  the  model  which  communicated  effectively  to  a  wide  audience.  For  this  reason, 
it  is  now  published  (modified  and  expanded)  in  the  Laboratory’s  Technical  Report  series. 
Readers  desiring  more  details  concerning  the  Policy-Capturing  Model  and  its  application 
should  refer  to  Bottenberg  and  Ward  (1963),  Bottenberg  and  Christal  (1961),  Christal  (1963, 
1965),  and  Ward  and  Davis  (1963). 

This  research  was  completed  under  Project  7734,  Development  of  Methods  for 
Describing,  Evaluating,  and  Structuring  Air  Force  Occupations;  Task  773402,  Develop¬ 
ment  and  Appraisal  of  Methods  for  Job  Evaluation;  and  Project  7719,  Development  of 
Procedures  for  Increasing  the  Efficiency  of  Selection,  Evaluation,  and  Utilization  of 
Air  Force  Personnel;  Task  771901,  Mathematical  and  Statistical  Techniques  to  Facili¬ 
tate  Research  on  the  Utilization  of  Air  Force  Personnel. 

This  report  has  been  reviewed  and  is  approved. 


James  H.  Ritter,  Colonel  USAF 
Commander 


j  w  .  /* irs 
Technical  Director 


ABSTRACT 


This  paper  describes  how  a  mathematical  equation,  derived  with  the  fixed-X 
multiple  linear  regression  model,  can  be  used  to  define  and  implement  the  policy  of 
an  individual  or  rating  board.  The  model,  which  has  been  discussed  in  previous  papers, 
is  described  in  easy-to-follow,  non-technical  language.  Several  applications  of  the 
model  are  presented. 
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SELECTING  A  HAREM— AND  OTHER 
APPLICATIONS  OK  THE  POLICY-CAPTURING  MODEL 

I.  A  SHORT  TABLE 

Once  upon  a  lime,  there  was  an  Oriental  king  who  was  concerned  as  to  how  he  might  make  a 
name  for  himself  in  history.  "1  know,”  he  said,  "I’ll  select  a  harem  larger  than  King  Solomon’s." 

So  the  word  went  out,  and  soon  thousands  of  young  girls  were  arriving  from  the  various  pro¬ 
vinces  to  seek  the  king’s  approval. 

Early  one  morning  the  king  began  his  selection  process.  As  each  girl  filed  by,  he  looked 
her  over  carefully  and  then  expressed  his  judgment. 

"Excellent!"  he  would  say.  "This  one  is  very'  pleasing  to  my  eye."  Or  perhaps  he  would 
hum  and  haw'  with  indecision.  Many  times  he  would  show  his  disapproval  in  no  uncertain  terms. 
"Never!"  he  would  say.  "Pass  on!  Pass  on!" 

In  each  instance,  the  Court  Recorder  attempted  to  quantify  the  king's  degtee  of  approval  by 
checking  the  appropriate  level  on  a  9-point  scale  which  had  been  devised  especially  for  the 
occasion  by  the  Chief  of  the  Royal  Psychomenicians. 

By  suppertime  the  king  had  considered  some  300  girls.  His  eyes  and  his  imagination  were 
beginning  to  tire. 

"Most  High  First  Counselor,"  he  said,  "you've  been  watching  me  all  day,  and  by  now  you 
should  know  my  likes  and  my  dislikes.  I've  decided  to  leave  the  selection  of  my  harem  in  your 
hands.  But  take  care!  If  your  choices  do  not  please  me,  it  will  be  your  head!" 

After  the  king  retired,  the  Most  High  First  Couselor  summoned  the  Chief  of  the  Royal  Psycho- 
metricians.  "I’m  passing  the  job  on  to  you,"  he  said.  "If  you  fail  to  please  the  king,  your  head 
will  roll  along  with  mine." 

The  Chief  of  the  Royal  Psychomeccicians  called  his  staff  together  and  explained  the  situation, 

"We  must  not  fail,"  he  said,  "or  it  will  be  all  of  our  heads." 

"How  shall  we  proceed?"  asked  one  of  the  young  staff  members  who  was  fresh  out  of  the 
Royal  Academy. 

"Well,"  responded  the  Chief,  "we  know  how  the  king  rBted  the  first  300  girls.  Right?” 

"Right!" 

"And  wc  can  see  everything  the  king  saw  when  he  looked  at  the  girls.  Right?  ’ 

"Right!" 

"Then  all  we  have  to  do  is  to  uncover  the  girly  characteristics  considered  by  the  king  and 
determine  how  he  weighted  them  in  his  judgment.  This  is  a  natural  for  the  Multiple  Linear 
Regression  ModeL"  (See  Bottenberg  Sc  Ward,  1963) 

"But  how  do  we  know  which  characteristics  he  considered?"  asked  the  neophyte. 

"We  don't,  you  fool!  Didn’t  they  teach  you  anything  in  that  school?  That’s  what  the 
regression  model  is  for.  If  a  girly  characteristic  adds  to  our  ability  to  predict  the  king’s  ratings, 
we  may  assume  he  gave  it  consideration.  Now  let’s  get  on  with  the  business." 

"How  about  height?"  asked  one  of  the  staff  members.  "Does  the  king  like  short  girls  or 
tall  girls?" 
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"Neither,"  replied  anutiici,  "1  would  guess  that  the  relationship  between  height  and  the 
king’s  preference  is  curvilinear.  Some  girls  arc  too  tall,  while  others  are  too  short." 

"Well,"  responded  the  neophyte,  "if  the  relationship  is  curvilinear,  then  we  cannot  use 
the  lineat  regression  model.  If  we  were  to  plot  the  curve  between  height  and  acceptability,  1 
think  we  would  find  it  to  be  parabolic." 

"They  really  didn't  teach  you  very  much  in  that  school,  did  they?"  commented  the  Chief. 
"What  is  the  general  equation  for  a  parabola?" 

"aX2^  bX  +  c,”  responded  the  neophyte. 

"Dravo!"  declared  the  Chief.  "Now  let  X  be  a  vector  of  heights.  If  wc  square  each  value  in 
the  heigh.  voc:-»,  ....  ,  eneratc  a  new  vector  X  .  Now  if  wc  introduce  these  two  predictors  in  the 
regression  model,  what  will  be  the  form  of  the  resulting  equation?" 

"aX2  i  bX  plus  the  regression  constant  c,"  replied  the  young  man. 

"Simple,  isn’t  it?"  responded  the  Chief.  "You  see,  there’s  no  problem  in  fitting  curvi¬ 
linear  relationships  with  the  linear  regression  model  as  long  as  the  pioper  power  terms  are  intro¬ 
duced  as  predictors.  The  linear  restriction  is  on  the  weighting  system,  not  on  the  form  of  the 
predictors.”  (See  Figure  1) 


Height  of  Applicant  (X) 

5'  00”  6’  10" 


Fig.  1.  Relationship  between  applican’  height  and  judged  acceptability. 

"How  about  eye  color?"  asked  one  of  the  other  staff  members  who  was  eager  to  move  on. 
"I'm  sure  the  king  looked  at  the  color  of  each  girl’s  eyes." 

"Fine,"  said  die  Chief,  "we  will  consider  eye  color  in  our  equations.  Since  eye  color  is 
not  an  ordered  variable,  we  must  introduce  a  separate  categorically  coded  predictor  for  each 
color." 
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"U1i.it  the  Chil  i  means."  whispered  one  of"  tin-  M  ill  member--  to  tin  neophyte,  "is  tli.it  for 
il  variable  .ismh iatc-d  'vitli  .1  particular  eye  color,  each  girl  will  hr  assigned  a  value  of  1  if  ho 
eves  arc  that  color  and  a  value  of  0  if  her  eyes  are  ilor  that  color. ’’ 

"It’s  been  my  observation,"  said  one  of  the  group.  addressing  the  (.Jiic-f,  "that  the  king 
likes  blue  eyes  on  blondes,  blit  not  on  brunettes.” 

"That’s  easily  handled,”  responded  (lie-  (duet.  ”1  list  we  will  introduce  categorical  pic- 
dietors  for  each  hair  color;  then  we  can  cioss-mult  iply  eye-color  and  hair-color  variables  el  order 
ro  generate  the  appropriate  interaction  predictors.’’  (See  Table  1) 

"1  thought, "  said  one  of  the  group.  "that  the  regression  model  assumes  the  predictors  10 
be  normally  distributed,  and  also  that  tb<  ir  joint-distnbution  is  notnial,  Ue  certainly  can’t  meet 
meet  these  assumptions  using  powered  terms,  mtci.tctinn  reitiis,  and  caccgoi ieally  coded  predictors.” 

"f  ou  re  rivii.,  *  „.,iJ  .1..  Chief,  "if  you’rr  d.h  !  h.^.  ..bout  die  mm,. -normal  model.  Hut  we’re 
going  to  use  die  fixt-d-X  model,  which  does  not  involve  those  assumptions.  Ue  would  be  stupid 
to  restrict  ourselves  to  normally  distributed  predictors.  Ir  would  force  us  to  omit  most  of  the  vari¬ 
ables  which  we  know  the  king  considered.” 

"Hut,”  objected  the  staff  nicmhcr,  "if  we  use  the  fixed-X  model,  we  cannot  generalize  be¬ 
yond  the  computing  sample,” 

"Who  can’t?”  responded  the  Chief."!  er’s  not  assume  out  erju.it  ion  will  fail  to  hold  up  just 
because  our  predictors  arc  not  normally  distributed." 

"W-P,  Pin  from  Outer  Missourivich,"  said  the  staff  member. 

"Very  well,”  replied  the  Chief,  "if  it  will  make  you  feel  better  we  will  develop  our  equa¬ 
tion  on  the  first  150  girls  rated  by  the  king,  and  then  check  how  well  the  equation  predicts  his 
judgments  of  the  remaining  150  girls.” 

And  so  went  the  conference  into  the  wee  hours  of  the  morning.  Over  a  hundred  predictors 
were  eventually  defined,  each  representing  a  girly  characteristic  which  might  have  influenced  the 
king’s  judgments.  The  lime  ha.  now  come  for  the  acid  test.  Could  they  produce  an  equation  which 
would  simulate  the  king? 


Tabic  1.  Kxumples  of  (allegorically  Coded  and  Interaction  J’redielors 
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Some  of  the  royal  guards  had  to  be  calk’d  in  to  help  measure  and  evaluate  each  girl  on  the 
predictor  variables.  It  was  a  niitdhou.se  with  -?0  guards  checking  eye  colors,  weighing  and  measur¬ 
ing  the  300  girls. 

By  late  afternoon,  the  raw  data  had  been  accumulated*  All  that  night  and  throughout  the  next 
day  and  night,  one  could  heat  the  constant  clicking  of  tile  abaci  beads  coming  from  the  royal  com¬ 
puting  shop.  Then  came  the  answer: 

"Wc  got  an  R  of  .87,  and  it  held  up  in  the  cross-application  sample/'  reported  a  messenger 
to  the  Chief  of  the  Royal  Psychomctt icians,  who  was  with  his  staff  in  the  coffee  ioorti  anxiously 
awaiting  the  results. 

"Hmm,"  said  the  Chief,  "that's  pretty  good.  Hut  it's  not  good  enough  for  me  to  risk  my  head 
on  it.  There  must  be  some  variable  we  failed  to  consider." 

"Maybe  the  king  likes  girls  who  look  like  his  mother,"  offered  the  neophyte.  "Men  often  do." 

"You're  a  genius."  said  the  Chief.  "It's  certainly  worth  a  try." 

"How  can  we  quantify  that?"  asked  a  staff  member.  "You  can’t  measure  it  with  a  yard- 
stick." 

"WcTI  establish  a  rating  hoard,"  responded  the  Chief,  "Bach  hoard  member  will  judge  how 
much  each  girl  looks  like  the  king’s  mother.  Wc  will  use  an  average  of  their  ratings  for  each  girl 
as  our  new  predictor." 

W!w;>  the  new  variable  was  introduced  into  the  king’s  policy  equation,  the  R?  jumped  to  .94. 
r  very  one  now  felt  contidetu  that  they  had  an  equation  which  would  truly  simulate  the  king.  The 
rest  was  routine.  By  the  end  of  the  week,  all  of  the  8,000  girls  in  the  applicant  pool  had  been 
evaluated  by  the  final  policy  equation,  and  those  with  the  highest  composite  scores  wvre  selected. 

The  king  was  very  pleased  with  the  results,  and  as  a  reward,  he  gave  the  Most  High  hirst 
Counselor  and  the  Chief  of  the  Royal  Psy t hometriciuns  their  choice  of  the  leftovers. 

ii.  \  miNs  oi  mi  ;  polka  -c  ap  it  .him;  modi  l 

Capturing  the  Policy  of  u  Hoard 

The  preceding  fable  describes  capturing  the  policy  of  a  single  judge.  However,  if  there 
is  high  iriterruter  agreement  among  members  of  a  policy  board,  then  mean  values  can  be  used  ns 
the  criterion  vector  to  represent  the  entire  board.  If  interrater  agreement  is  low',  it  may  be  that 
(he  raters  can  be  divided  into  two  or  more  groups  within  each  of  which  there  is  high  agreement. 

This  can  be  accomplished  through  application  of  a  hierarchical  giouping  technique  which  clusters 
judges  in  terms  of  the  homogeneity  of  their  prediction  equations  (Christal,  1963;  Bottenberg  & 
Christal,  1961).  Thus,  if  more  than  one  policy  exists  among  board  memU  rs,  each  such  policy 
can  bt  identified  and  described.  Differences  in  policies  are  therein  pn>j  ointed  fur  arbitration. 

A  Trw  Previous  Application*  of  the  Model 

The  policy -canruf mg  model  has  been  applied  in  many  studies  conducted  by  rite  Pcrsomu  1 
Research  Laboratory.  Tquarions  developed  thusfar  have  been  highly  valid  and  have  held  up  on 
cross-application.  For  example,  equations  have  been  developed  to  simulate  officer  promotion 
boards.  These  equations  will  predict  with  a  high  degree  of  accuracy  the  ratings  a  board  will 
give  to  officers  under  consideration.  Recently,  equations  were  developed  to  simulate  the  acrions 
of  career  counselors  in  making  the  initial  assignments  of  airmen  graduating  from  bask  training. 
These  equations  arc-  now  being  used  in  an  operational  computer-assisted  assignment  system. 
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One  study  w a coudui  uni  to  determine  the  relative  impnn.ouc  of  certain  variables  in 
accounting  lor  the  profiocncv  of  airmen  working  in  particuLii  career  laddc:  s (Nay  lor  &  Uhciry, 
l‘X»  0.  'I  his  tould  have  beer  av compl isin  d  by  having  supervisors  rate  th  profit  ieiic>  of  incum¬ 
bents  who.  in  tin::,  had  been  measured  on  the  variables  under  considerate  n.  The  m.iiti  expense 
in  such  an  approach,  however,  is  associated  with  the  collection  o!  prod'ctoi  information,  winch 
would  involve  the  administration  of  tests  and  the  collection  of  ratings  on  hundreds  of  workers 
at  dozens  of  Air  Force  bases,  Instead  of  usin^  dau.  collected  on  teal-live  people,  therefore, 
samples  were  "'created*1  by  ascribing  scores  to  simulated  workers.  It  can  be  demonstrated  that 
exactly  tile  same  equation  will  be  obtained  using  simulated  cases  as  will  be  obtained  using 
real  subjects,  provided  two  conditions  are  met.  hirst,  ever)’  case  generated  must  be  conceivable 
to  the  judge.  That  is,  a  case  may  not  be  described  as  being  18  years  old  and  bavins  25  years  of 
education.  Second,  the  scores  must  be  ascribed  in  a  manner  which  assures  icasonablc  variance 
for  each  predictor.  In  this  particular  study,  several  samples  of  250  simulated  cases  each  were 
developed,  and  not  one  of  the  judges  realized  that  he  was  rating  artificial  incumbents.  luithet- 
tnore,  many  of  the  obtained  policy  equations  correlated  above  .90  with  ratings  obtained  from  these 
judges.  Similar  results  have  been  obtained  in  other  studies  using  simulated  stimuli  (MuJdcn, 

1%3;  Madden  Ac  Giorgia,  1%?). 

'I  he  Officer  (irude  Requirements  I’rojeet 

The  Officer  Grade  Requirements  (OGR)  Project  is  probably  the  largest  effort  on  record  involv¬ 
ing  rhe  capturing  and  implementation  of  policy  in  an  operational  setting  (Christal,  September  HX>5). 
The  Director  of  Air  Force  Manpower  and  Organization  asked  the  Personnel  Research  Laboratory  if 
it  could  conduct  a  study  to  determine  the  appropriate  distribution  of  grades  for  jobs  in  various 
officer  specialties  and  utilization  fields.  Me  said,  "J;ine-if  you  will  make  a  polio*  decision  con¬ 
cerning  the  appropriate  grade  levels  for  a  sample  of  jobs  which  we  will  select,  then  we  will  provide 
you  with  a  system  to  determine  the  appropriate  grade  levels  for  the  rest  of  the  jobs  in  the  Air 
Force.” 

The  agreement  war;  made,  and  as  a  first  step  comprehensive  job  descriptions  were  collected 
from  85,000  officers.  A  sample  of  3,575  descriptions  representing  jobs  at  all  levels  in  all  special¬ 
ties  was  selected  from  this  file.  Then  a  policy  board  composed  of  22  colonels  was  called  by  Head¬ 
quarters  USA F  to  determine  the  appropriate  grades  for  jobs  in  the  sample. 

<  oii t't’ftnti  of  titi f /wg.s  fmtr  ii  <  f'ofi i>  /h, »//./.  Using  a  i0-point  scale,  five  members  of  the 
board  provided  independent  grade  ratings  fot  each  id  the  3,575  jobs.  The  scale  provided  for  three 
levels  within  each  grade.  That  is,  the  rater  had  to  indicate  whether  a  job  is  most  appropriately 
filled  by  a  senior  colonel,  a  colonel  with  average  time  in  giudc,  ot  a  junior  colonel.  Hoard  members 
had  access  to  any  information  needed  about  the  nature  of  a  job  being  rated,  bits?,  they  had  rhe 
job  description.  If  they  needed  more  information,  they  could  consult  the  members  of  a  panel  iden¬ 
tified  as  being  knowledgeable  in  the  relevant  career  area.  11  that  was  not  enough,  they  could  call 
special  air  staff  consultants  available  .it  Headquarters  I'SAl  .  I  in.tlly,  if  necessary,  they  could 
telephone  the  supervisor  of  the  incumbent  in  the  j»»b  being  rated. 

Ratings  were  independent.  Hoard  members  were  nut  allowed  to  have  knowledge  of  the  current 
Unit  Manning  Document  grade  author i zat ion  lor  the  job.  They  were  not  informed  of  the  grade  held 
by  the  incumbent  or  by  his  supervisor.  Memlw  r^  were  not  jxf  united  to  question  other  board  members 
or  consultants  concerning  tile  appropiiatc  grade  fm  the  job  being  rated. 
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Analysis  of  thuinl  Ratings.  Since  ratings  provided  by  rhe  policy  board  were  to  be  used  for 
establishing  Air  Force  grade  requirements,  it  was  important  to  demonstrate  that  these  ratings  were 
stable;  that  there  was  high  agreement  among  board  members  concerning  grade  requirements  for  par¬ 
ticular  jobs;  that  the  raters  had  confidence  in  their  ratings;  and  that  the  raters  were  nor  biased 
for  or  against  jobs  in  various  specialties  or  commands.  A  scries  of  analyses  of  the  policy  board 
ratings  was  accomplished  to  evaluate  the  quality  of  their  ratings 

Results  from  these  analyses  were  encouraging.  First,  the  interrater  agreement  was  correlated 
at  .92,  which  was  considered  acceptable  for  the  proposed  application.  Second,  the  raters  expressed 
a  high  level  of  confidence  in  their  grade  ratings  ol  the  3.575  jobs  in  the  criterion  sample.  For 
2,387  of  the  jobs,  at  least  four  of  the  five  raters  expressed  uu*  highest  levei  of  confidence  in  their 
judgments.  Only  59  jobs  had  an  associated  confidence  level  of  less  than  2.00  on  a  3 -point  scale. 
Finally,  analyses  indicated  that  hoard  members  were  not  simply  giving  back  the  grade  levels  cur- 
rently  authorized  for  jobs;  and  that  they  did  not  recommend  a  wholesale  across-the-board  increase 
in  grade. 

Table  2  shows  summary  results  of  an  analysis  designed  to  identify  raters  exhibiting  a  bias 
for  or  against  jobs  in  a  particular  command  or  occupational  grouping.  The  values  in  the  table  are 
rhe  differences  between  the  average  of  ratings  assigned  by  a  rater  on  the  1 6-point  scale  to  jobs  in 
a  particular  category'  and  the  average  of  ratings  assigned  by  all  raters.  Since  three  points  on  the 
16-point  scale  represent  one  grade  level,  a  value  of  3.0  in  the  table  would  indicate  that  a  board 
member  rated  jobs  in  a  given  category  approximately  one  grade  higher  than  other  board  members. 
Similarly,  a.  value  of  -3-0  would  indicate  judgments  averaging  one  grade  lower  than  those  of  other 
members.  The  highest  reported  value  is  1.7,  and  most  of  the  values  arc  less  than  1.0.  The  larg¬ 
est  values  tend  to  be  associated  with  judges  who  rated  all  categories  somewhat  high  or  low,  and 
these  judges  did  not  show  a  bias  toward  jobs  in  particular  categories. 

Development  of  a  Policy  i.tfuatinn.  Once  the  policy  board's  grade  ratings  for  jobs  in  the  cri¬ 
terion  sample  had  been  accepted,  attention  was  directed  toward  development  of  a  policy  equation. 
This  turned  out  to  be  a  challenging  bit  of  detective  work  because  no  information  was  available  to 
indicate  the  factors  considered  by  board  members  in  making  their  decisions  about  grade  require¬ 
ments.  During  an  eight-month  period,  nearly  200  variables  which  might  have  influenced  the  board’s 
judgments  were  hypothesized  and  evaluated.  Slowly  but  surely,  .  ter  computation  of  several  hundred 
equations,  a  relatively  simple  9-predictor  system  evolved  which  adequately  expressed  the  board’s 
policy.  livery  one  of  these  predictors  had  higli  face  validity  for  grade;  and  when  properly  weighted 
together,  they  piou»ieeu  a  job  evaluation  composite  which  had  U  correlation  of  .92  with  the  judg¬ 
ments  of  the  board  in  the  3,575  case  sample. 

Table  3  describes  the  variables  in  the  final  equation.  The  first  five  variables  are  job  evalua¬ 
tion  factors  rated  by  lieutenant  colonels  and  majors  in  the  field  and  may  he  considered  the  primary 
definers  of  officer  grades.  According  to  the  policy  equation,  the  grade  of  an  officer  job  is  deter¬ 
mined  first  by  the  complexity,  variety,  and  level  of  activities  managed;  second,  by  the  scope  and 
significance  of  work  for  which  planning  is  done;  third,  by  the  requirements  for  special  training 
courses  and  on-thc-job  experience;  fourth,  by  rhe  importance  and  independence  of  judgments  and 
decisions  required  by  the  job;  and  fifth,  by  the  level  of  agencies  and  individuals  with  which  or  with 
whom  the  incumbent  must  communicate,  ic  is  also  noted  that  the  organizational  level  of  the  job  and 
level  of  the  job  within  this  organ i/.  vtiun  help  to  determine  the  appropriate  grade  level.  It  was  found 
that  superv  sors*  judgments  concerning  the  appropriate  grade  level  for  jobs  tended  to  be  inflated. 
However,  since  the  equation  automatically  adjusted  supervisory  ratings  to  bring  them  into  I  me  with 
the  policy  board’s  recommendation,  this  variable  was  found  useful  for  inclusion  in  the  equation. 
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Table  3.  Definition  of  Variables  Included  in  Officer  Grade  Requirements  Policy  Equation 


V«riwS« 

Number 

Voriobi* 

Hama 

Variable  DaflnlVltn 

Sourca  of 

Data 

1 

Management 

The  level  of  executive  and  managerial  skills 
required  by  the  job.  The  complexity,  variety 
and  level  of  the  activities  which  we  directed, 
organized,  coordinated,  controlled,  commanded, 
or  evaluated. 

Mean  ratings  for 
each  job  obtained 
from  five  field 
judges 

2 

Planning 

The  extent  to  which  planning  is  required  by 
the  job.  The  scope  and  significance  of  work 
for  which  planning  is  done.  The  longer  the 
time  span  for  which  planning  is  done,  the 
higher  the  rating. 

Mean  of  racings 
for  each  job  ob¬ 
tained  from  five 
field  judges 

3 

Special 
Training 
and  Work 
Experience 

The  extent  to  which  the  job  requires  knowl¬ 
edges  and  skills  which  must  be  acquired 
through  special  training  courses  or  on-the-job 
experience.  Does  not  include  general  courses 
given  by  Squadron  Officer  School,  Air  Com¬ 
mand  and  Staff  College,  or  Air  War  College. 

Mean  of  ratings 
for  each  job  cb- 
tained  from  five 
field  judges 

4 

Judgment 
and  Deci¬ 
sion  Mak¬ 
ing 

The  importance  and  independence  of  Judg¬ 
ments  and  decisions  required  by  the  job.  The 
nature,  variety,  and  possible  impact  of  deci¬ 
sions.  The  less  well  defined  the  guidance  for 
decisions,  the  higher  the  rating;  while  the 
more  specific  and  detailed  the  guidance,  the 
lower  the  tating. 

Mean  of  ratings 
for  each  job  ob¬ 
tained  from  five 
field  judges 

5 

Communica¬ 
tions  Skills 

The  extent  to  which  the  job  requires  skill  in 
oral  and  written  communication  as  well  as 
the  level  of  the  individuals  and  agencies  in¬ 
volved. 

Mean  of  ratings 
for  each  job  ob¬ 
tained  from  five 
field  judges 

6 

Level  uf 
Organiza¬ 
tion  in 

Which  Job 
Occurs 

DODorHqUSAF  -9 

Hq  Major  Air  Command  -8 

Numbered  AF  or  equivalent  «7 

Air  Division  or  equivalent  -6 

Wing  or  equivalent  *>  5 

Group  or  equivalent  ■  4 

Squadron  or  equivalent  «3 

Detachment  or  equivalent  -  2 

Other  «0 

Data  from  Job 
Description 

Form 

7 

Level  of 

Job  Within 
Organiza¬ 
tion 

Command  Element  *=7 

Directorate,  Department,  Office 
or  equivalent  »6 

Division  or  equivalent  -5 

Branch  or  equivalent  -4 

Section  or  equivalent  »3 

Unit  or  equivalent  «  2 

Other  "0 

Data  from  Job 
Description 

Form 

8 

Field 

Grade 

Rating 

Racing  of  appropriate  grade  for  job  using 
the  16-point  OGR  Grade  Rating  Scale, 

Mean  ratings  for 
each  job  obtained 
from  five  field 
judges 

9 

Supervisor’s 
Grade  Rating 

Supervisor's  rating  of  appropriate  grade  for 
job  using  a  7-point  scale. 

Data  from  Job  Des¬ 
cription  Form 

8 


After  a  satisfactory  policy  equation  was  developed,  it  was  applied  to  determine  the  grade 
requirements  for  an  additional  10,000  jobs.  These  results  were  projected  to  determine  the  appro¬ 
priate  distribution  of  grade  for  various  specialties  and  specialty  groupings  (Christal,  1965). 

With  its  implications  on  the  establishment  of  Air  I-'orce  officer  grade  requirements,  the  OGR 
study  illustrates  an  important  application  of  the  policy-capturing  model,  In  this  study,  the  model 
permitted  expression  of  the  policy  of  a  board  in  a  definite  and  precise  manner  and  definition  of  the 
meaning  of  grade  to  this  board. 


111.  SUMMARY  AND  CONCLUSIONS 

A  model  has  been  described  for  defining  and  implementing  the  policy  of  a  rating  board  or  an 
individual.  The  policy  board  is  required  to  study  relevant  information  and  to  prescribe  the  correct 
decisions  ot  actions  to  be  taken  in  a  sample  of  situations.  The  multiple  linear  regression  model 
is  employed  to  identify  the  variables  considered  by  the  board,  and  to  determine  how  these  variables 
must  be  weighted  to  reproduce  the  board's  actions.  The  resulting  equation  is  called  a  policy  equa¬ 
tion.  Application  of  die  policy  equation  for  subsequent  decision  making  is  cailed  policy  simulation, 
since  the  equation  literally  simulates  the  board. 

Studies  thusfar  conducted  indicate  that  policy  boards  are  highly  consistent  in  their  judg¬ 
ments  when  the  problem  is  well  defined  and  when  relevant  information  is  available.  Policy  equa¬ 
tions  developed  using  the  regression  model  have  been  very  accurate.  Equations  are  easiest  to 
derive  when  data  considered  by  the  board  are  known  and  are  already  quantified.  However,  it  is 
usually  possible  for  an  investigator  to  identify  the  appropriate  variables  when  they  are  not  defined. 
This  is  accomplished  by  a  system  of  hypothesis  testing.  When  case  data  are  not  available  to  the 
board,  it  is  still  possible  to  develop  a  policy  equation,  using  cases  which  have  been  created  by 
ascribing  to  them  score  values  on  relevant  variables. 

In  the  Air  Force,  boards  are  frequently  convened  to  determine  how  variables  should  be 
weighted  together  for  making  decisions.  Who  shall  be  promoted?  Who  shall  be  returned  to  active 
flying  3tatus?  Which  specialties  shall  be  given  proficiency  pay?  Which  officers  shall  be  inte¬ 
grated  into  the  regular  Air  Force?  Who  shall  be  retired?  The  solution  of  all  such  problems  involves 
the  weighting  together  of  factors  judged  to  be  relevant  for  the  achievement  of  agreed-upon  goals. 

If  these  factors  are  made  explicit,  then  the  multiple  linear  regression  analysis  model  can  be  applied 
to  derive  a  precise  statement  of  the  factors  and  weights  to  be  used  in  carrying  out  the  board’s 
recommendations. 

Applications  of  the  policy-capturing  model  described  in  this  paper  have  been  drawn  primarily 
from  the  military  setting.  However,  one  can  easily  see  how  the  model  might  be  applied  to  study 
such  diverse  properties  as  the  quality  of  beefstock,  the  beauty  of  pictures,  the  effectiveness  of 
workers,  the  quality  of  English  compositions,  or  the  acceptability  of  applicants  for  a  king’s  harem. 
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